Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients

Published in Neurips (under review), 2025

Recommended citation: Yezhen Wang*, Zhouhao Yang*, et al. "Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients." arXiv preprint arXiv:2505.01744 (2025). https://arxiv.org/abs/2505.01744